I already said it wasn't an ideal solution, but you asked for a simple one........

Yes, you can swap out diaphragms.

If you have an amp with 16 ohm taps, then there's less potential current draw, ergo less potential thermal power compression/longer component life, smaller wire requirements, etc..

GM